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Abstract 

We perform a systematic study of the production of a third-generation fermion- 
pair, — * ff for / = r~ ,b, and t in the minimal super symmetric standard model 
(MSSM) with explicit CP violation, which is induced radiatively by soft trilinear 
interactions related to squarks of the third generation. We classify all the observables 
for probing the CP property of the Higgs bosons constructed by the initial muon beam 
polarization along with the unpolarized final fermions and with the final-fermion 
polarization configuration of equal helicity, respectively. The observables allow for 
complete determination of CP property of the neutral Higgs bosons. The interference 
between the Higgs boson and gauge boson contributions also could provide a powerful 
method for the determination of the CP property of two heavy Higgs bosons in the 
top-quark pair production near the energy region of the Higgs-boson resonances. 
For the lightest Higgs-boson mass there is no sizable interference between scalar and 
vector contributions for the determination of the CP property of the lightest Higgs 
boson. We give a detailed numerical analysis to show how the radiatively-induced 
CP violation in the Higgs sector of the MSSM can be measured. 

PACS number(s): 12.60.Jv, 11.30. Er, 13.10.+q, 14.80. Cp 



1 



1 Introduction 



Search for the Higgs bosons and the precise measurements on their properties, such as the 
masses, the decay widths and the decay branching ratios, are the most important subjects 
to study the mechanism of the electroweak symmetry breaking [J] . In the Standard Model 
(SM), only one physical neutral Higgs boson appears. On the other hand, models with 
multiple Higgs doublets have CP-even and odd neutral Higgs bosons as well as charged 
Higgs bosons, if CP is a good symmetry. Otherwise, the neutral Higgs bosons do not have 
to carry any definite CP-parity. 



CP violation was observed in the neutral kaon system and the violation in B-meson 
decays is strongly suggested by recent experiments ||. In addition, CP violation constitutes 
one of the crucial ingredients for an efficient non-SM generation of the cosmological baryon 
asymmetry at the electroweak scale ||. An appealing scheme of CP violation beyond the 
SM can be provided by models with an extended Higgs sector where the CP asymmetry is 
broken by the ground state of the Higgs potential. It has recently been realized that, even 
though the Higgs potential of the minimal supersymmetric SM (MSSM) is CP-invariant at 
the tree level, explicit CP violation in the mass matrices of the third generation squarks can 
induce sizable CP violation in the MSSM Higgs sector through loop corrections || || [7|, [| . 
The CP violating phases for the third generation sfermions can be quite large, since they 
contribute to the electric dipole moments (EDM's) of the electron and neutron only at 
the two-loop level with no generation mixing [] in the sfermion sector [fLOfl . As a result, 
although a one-loop effect, the induced CP violation in the MSSM Higgs sector can be 
large enough to significantly affect Higgs phenomenology at present and future colliders 

H [TJ|, [T5], |T7[. In this light, it is very important to examine the possibility of observ- 
ing these Higgs bosons and investigating their properties in detail. 



A muon collider is one of the ideal machines to look for the Higgs bosons and their 
properties, where fi + n~ pairs can be directly converted into neutral Higgs-boson reso- 
nances [0, [L9[ . Polarized muons can be used to detect the Higgs bosons and measure their 



properties such as masses, total widths, decay branching fractions and CP parities |20| , [21 
In this paper, we present a general formalism and a detailed analysis for the Higgs-boson 
effects on the polarization observables of the production process — > ff (f = r~,b and 
t) using the initial muon beam polarization along with the unpolarized final fermions and 
with the final-fermion polarization configuration of equal helicity, respectively. It has been 
recently pointed out that the amplitudes for two Higgs states, a scalar and a pseudoscalar, 
can interfere with each other sizably if the helicities of the initial and final particles are 



*The CP-violating phases associated with the sfermions of the first and second generations can be 
severely constrained by the EDM constraints. However, there have been several suggestions |ll|, to 
evade these constraints without suppressing the CP-violating phases. 
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properly fixed and if the mass difference of these Higgs bosons is at most of the same order 
as their decay widths [2^]. We extend the work comprehensively in order to consider Higgs 
bosons of no definite CP-parity in the MSSM with explicit CP violation induced from the 
third generation squark sectors. 



The remainder of this article is organized as follows. Section |2| is devoted to a brief review 
of the explicit CP violation in the MSSM Higgs sector based on the work ||. In section |3] 
we present the helicity amplitudes of the production of a fermion pair in collisions 
and give a comprehensive classification of the observables according to the CP and CPT 
transformation properties that are constructed by the initial muon beam polarization along 
with the final fermions of no polarization and of equal helicity, respectively. In section |4] we 
make a detailed numerical analysis based on a given parameter set so as to get a concrete 
estimate of the usefulness of the observables. Section || is devoted to a brief summary of 
our findings and to a conclusion. 



2 Explicit CP Violation in the MSSM Higgs Sector 

The existence of the non-trivial CP-violating phases in the MSSM is due to the breakdown 
of supersymmetry so that the CP-violating phases appear in the soft-breaking parameters 
and the mixing among sparticles due to the electroweak gauge symmetry breaking. There 
are three well-known sources of CP violation in the MSSM | 23| . The first is related to the 



two Higgs-boson doublets present in the model since both the /i parameter in the super- 
potential and the soft breaking parameter m\ 2 can be complex. Secondly, there are three 
more phases of the complex masses of the U(l)y, SU(2) L and SU(3)c gauginos of the SM 
gauge group. Thirdly, the other CP-violating phases originate from the flavor sector of the 
MSSM Lagrangian, either in the scalar soft mass matrices or the trilinear matrices. 

The CP-violating phases associated with the off-diagonal terms of the trilinear matrices 
are, however, strongly suppressed by the same mechanism required to suppress the flavor 
changing neutral current effects. Therefore, all these flavor-changing CP-violating phases 
are neglected in the present work such that the scalar soft mass matrices and trilinear 
parameters are flavor diagonal and the complex trilinear terms are proportional to the 
corresponding fermion Yukawa couplings. Clearly, the Yukawa interactions of the third- 
generation quarks and squarks play the most significant role in radiative corrections to the 
Higgs sector. In this section, we give a brief review of the calculation || of the Higgs-boson 
mass matrix based on the full one-loop effective potential, valid for all values of the relevant 
third-generation soft-breaking parameters. 

The MSSM contains two Higgs doublets Hi, H 2 , with hypercharges Y(H\) = —Y(H 2 ) = 
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— 1/2. Here we are only interested in the neutral components, which we write as 



V2 



+ ioi); #° = -j= {(j>2 + ia 2 ) 



where 01,2 and a\ j2 are real fields. The constant phase £ can be set to zero at tree level, but 
will in general become non-zero once loop corrections are included. 

The mass matrix of the neutral Higgs bosons can be computed from the effective po- 
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where the symbols g and g' stand for the SU(2) L and U(l)y gauge couplings, respectively. 
Q in Eq. (0) is the renormalization scale; the parameters of the tree-level potential, in 
particular the mass parameters mf, m\ and m\ 2 -, are running parameters, taken at scale 
Q. The potential @ is then independent of Q, up to two-loop corrections. 



The matrix M is the field-dependent mass matrix of all modes that couple to the Higgs 
bosons. The by far dominant contributions come from the third generation quarks and 
squarks. The (real) masses of the former are given by 



m. 
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(4) 



where h b and h t are the bottom and top Yukawa couplings. The corresponding squark mass 
matrices can be written as 
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m 2 ~ + m 2 -l(g 2 -^)v -h\ 
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Here, H® and H 2 are given by Eq. ([!]) while m 2 and ml are as in Eq. (^) and T> has been 
defined in Eq. (fj). In Eq. (H) m~, m~ and m~ are real soft breaking parameters, A b and 



At are complex soft breaking parameters, and \i is the complex supersymmetric Higgs(ino) 
mass parameter. 



The calculation proceeds by plugging the field-dependent top/bottom-(s) quark mass 
eigenvalues into the potential @. The mass matrix of the Higgs bosons (at vanishing 
external momentum) is then given by the matrix of second derivatives of this potential, 
computed at its minimum. In order to make sure that we are indeed in the minimum of the 
potential, we solve the stationarity relations, i.e. set the first derivatives of the potential to 
zero. This allows us to, e.g., express mf, m\ and m\ 2 sin(^ + ^ 12 ) as functions of the vacuum 
expectation values (vevs) and the remaining parameters appearing in the loop-corrected 
Higgs potential. The equations dVm^s/ da\ = and dVm g g S /da2 = are linearly dependent, 
i.e. lead to only one constraint on parameters for (a±) = (a 2 ) = 0; the remaining vevs are 
defined through (</>i) 2 + (<j) 2 ) 2 = v 2 ~ (246 GeV) 2 and (fa) / (<j>i) = tan/3. The re-phasing 

12 1 sin(£ + 0i 2 



invariant quantity \m 
the re-phasing invariant quantities 



is then determined by 



m i2 1 5 m f an d m 2 as well as by 
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which describe the amount of CP violation in the squark mass matrices. 



The mass matrix of the neutral Higgs bosons can now be computed from the matrix 
of second derivatives of the potential (0), where (after taking the derivatives) m 2 , m\ and 



m 



12 



sin(£ + 6*12) are determined by the stationarity conditions. The massless state G° 



ai cos/3 — a 2 sin f3 is the would-be Goldstone mode "eaten" by the longitudinal Z boson. We 
are thus left with a squared mass matrix A4 2 H for the three states a = a\ sin (3 + a 2 cos /3, fa 
and fa. This matrix is real and symmetric, i.e. it has 6 independent entries. The diagonal 
entry for a reads: 
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where and A^ are as in Eq. @ and the function g{m\, m 2 ,) is given by 
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The definition of the mass squared m\ and the dimensionless quantities X t ^, Rt,b and R' t b 
as well as the other CP-preserving entries of the mass matrix squared A4 2 H can be found 
in Ref. ||. As noted earlier, the size of these CP-violating entries is controlled by Aj and A^. 

The real, symmetric matrix A4 2 H can be diagonalized with an orthogonal rotation 0\ 

T M 2 H = diag^, m| 2 ,m 2 ), (11) 



with the ordering of mn x < mn 2 < mn s taken as a convention in the present work. Note 
that the loop-corrected neutral Higgs-boson sector is determined by fixing the values of 
various parameters; tua, /•*, At, Ab, a renormalization scale Q, tan/5, and the soft-breaking 
third generation sfermion masses, mg, m^, and m^. The radiatively induced phase £ is 
no more an independent parameter and it can be absorbed into the definition of the \x 
parameter so that the physically meaningful CP phases in the Higgs sector are the phases 
of the re-phasing invariant combinations A t ^,e 1 ^ and Abfxe 1 ^. This neutral Higgs-boson mix- 
ing changes the couplings of the Higgs fields to fermions, gauge bosons, and Higgs fields 
themselves so that the effects of CP violation in the Higgs sector can be probed through 
various processes |T3L O, pi. 



3 Third Generation Fermion Production 
3.1 Production amplitudes 

The couplings of the 7 and the neutral gauge boson Z to fermions in the MSSM is described 
by the same interaction Lagrangian as in the SM: 

= -eQfhj A» - -?—f \(T f3 - Q f s 2 w )P^ - Q f s 2 w P + \ lfl f Z» , (12) 

with the chirality projection operators P± — (1 ± 7s)/2, and those of the neutral Higgs- 
boson fields with leptons and quarks are described by the interaction Lagrangians 

hi 3 hfi 3 

^Hff = — 1=^2 ^[0 2 k-isf3 O^} £H k j= 2 d [0 2k - isp lk j 5 ] dH k 

V 2 k=1 V2 k=1 
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7= u l°3k ~ icp Oife7 5 ] uH k , 

v2 k=1 

where hi, hd, and h u are the lepton and quark Yukawa couplings: 

gmi gm d gm u 



hi = 



h d = 



h v , = 



(13) 
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respectively. It is then clear that all the neutral Higgs bosons couple dominantly to the 
third generation fermions t, b and r and they couple to a muon about 200 times more 
strongly than to an electron - the primary reason for having a muon collider. 
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Figure 1: The mechanisms contributing to the process — > //; three spin-0 neutral- 
Higgs-boson exchanges and spin-1 7 and Z exchanges. Here, the index k is 1,2 or 3. 



The fermion pair production process — > // is generated by five s-channel mech- 
anisms: spin-1 7 and Z exchanges and three spin-0 neutral-Higgs-boson exchanges, cf. 
Fig. 1. The transition matrix element of the process 
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V r , 
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can be expressed in terms of the scalar and vector bilinear charges, S a b and V a b, classified 
according to the chiralities a, b — ± for the right-/left-handed chiralities of the associated 
muon and produced fermion currents, respectively. Here, the scalar bilinear charges are 
given by: 



S a b — 



h^hf 



2 D hA s ) [°2k - iasp0 lk ] \s[ - ib£p0 lk 



k=i 
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where and hf are the initial muon and final fermion Yukawa couplings, respectively, and 
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(17) 



On the other hand, the vector bilinear charges V a b have the contributions only from the 7 
and Z boson exchanges: 



Vab = e 



-Q f + g%g f b D z (s) 



where Qf is the electric charge of the fermion, g± denote the right /left-handed couplings 
of the Z boson to the fermions, respectively: 

g{ = -Qj t&n9 w , g f _ = -Q f tan 9 W + . (19) 

Sy/Cw 

The vector bilinear charges V ao are real in the approximation of neglecting the Z boson 
width Tzi which is valid for the cm. energy away from the Z boson pole. 




Figure 2: The schematic description of the production plane with the scattering angles G 
and $ as well as the transverse polarization vectors Pt and Pt with the azimuthal angles 
a and a with respect to the scattering angle, respectively. 



Defining the polar angle of the flight direction of the fermion / with respect to the yT 
beam direction by (See Fig. 2), the explicit form of the production amplitude (|T^) can be 
evaluated in the helicity basis by the 2-component spinor technique of Ref. |[25|| . Denoting 



the /i~(/i + ) helicity by the first (second) index, the / and / helicities by the remaining 
two indices, then the general form of the helicity amplitude (era; AA), consisting of a scalar 
helicity amplitude and a vector helicity amplitude, reads 

(aa; XX) = (a a; XX) s + (aa; \\) v , (20) 

where the scalar helicity amplitude (era; AA) 5 is given by 

{aa- XX) s = ~ £ S ab (a + a(3,){b - A/3) <5 ct Aa , (21) 

ab 
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and the vector helicity amplitude (era; XX) v by 

1 
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A,-A 



Am^ruf 



(ab — aX cos 0) 8 aS 8 



2m,, 



+ 



s 

2m f 



[l + bX(3){asm6) <U*a,-a 
[1 + aa (3 fj,)(X sin Q) 8 a -^8 xx 



(22) 



respectively, with a,b = ±, /3„ 



4m^/s and (3 



ArrA/s. However, the muon 



mass (= 106 MeV) is extremely small compared to the present experimental mass bound 
of approximately 100 GeV on the lightest Higgs boson so that one can safely neglect all the 
terms involving the kinematical muon mass[]. In the approximation, the scalar and vector 
helicity amplitudes can be written as: 

(i) Scalar helicity amplitudes: 
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where /3± — (1 ± f3)/2. At asymptotically high energies /? 4 
scalar helicity amplitudes vanish. 

(ii) Vector helicity amplitudes: 
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(24) 



TFor consistency, the chirality-flipped Z-boson contributions to the scalar bilinear charges S a b, which 
are also proportional to the muon mass kinematically, should be neglected in the massless muon limit. 
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and again the other vector helicity amplitudes vanish. 

The CP transformation leads to the relation among the transition helicity amplitudes: 
(era; XX) A + (_i)(^)/2(_i)(A-A)/2 _ ^ _ A) j (25) 

or equivalently for the scalar and vector helicity amplitudes: 

(±±;AA) S ^ +( _i)(a-a)/2 (tt ._x ; _ a)s) 

(±=F;AA) V A _(_i)(a-a)/ 2(±t ._^_ a)v . (26) 

Only the simultaneous presence of the scalar and pseudoscalar couplings can lead to CP 
violation as can be explicitly checked in Eqs. ([21]) and fl22|) . One additional useful classifi- 
cation is provided by the so-called "naive" time reversal T; under the CPT transformations 
the helicity amplitudes are transformed as follows: 

(±±;AA) S ^ +( _i)(A-A)/2 (ffi _ A) _ A) * ) 

(±t;AA) v ^ _(_i)(a-a)/2 (±t ._ A) _ a) * (27) 

We note that it is crucial to have finite Z or Higgs-boson widths for CPT violation. In 
this light, it is very useful to take into account the CP and CPT properties of any physi- 
cal observable simultaneously so as to investigate not only CP violation itself but also the 
overlapping of any pair of three neutral Higgs boson resonances effectively. 



3.2 Polarized production cross section 

The matrix element squared for general (longitudinal or transverse) beam polarization can 
be computed either using standard trace techniques (employing general spin projection 
operators), or from the helicity amplitudes by a suitable rotation [25| from the helicity 
basis to a general spin basis. In the former case, neglecting the muon mass in the spin 
projection operators we can obtain the following approximated form for the /i T projection 
operators 



+ m)(l + 75 f) 



-(1 + PlJs) jf+^jsPricoea ^i + sina fa) p, 



2 (#-"0(1 + 75 P) 



PlHs) -75-Pr(cosa fa + sina fa) p. 



(2f 



Equivalently in the helicity basis the polarization weighted matrix element squared is given 
by 



£|-M| 2 = £ McfM^p-^pt* = \M p + M V 



(29) 
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where M. a a (c, a — ±) denotes the helicity amplitude for any given production process 
H~(a)/j, + (a) —>■ X and the 2x2 matrices p T are the polarization density matrices for the 
initial fi T beams: 



P 



1 

2 



1 + P L P T e~ ia 
P T e ia 1-P L 



P 



-P T e 



Pl -Pre" 

^ l-Pr 



(30) 



Here, Pl and Pl are the longitudinal polarizations of the fi~ and fi + beams, while Pt and 
Pt are the degrees of transverse polarization with a and a being the azimuthal angles be- 
tween the transverse polarization vectors and the momentum vector of / as shown in Fig. 2. 

Applying the projection operators (|28|) or/and evaluating the trace (|29D leads to the 
polarized matrix element squared of the form 

S = E E (^;AA)(a'a';AA)V; CT ,p^ 

A A cra'aa' 

1 - P l Pl) Ci + f Pl ~ Pl) C 2 



1 + PlPl) C 3 + [P L + Pl) C 4 
+ (Pt cos a + Pt cos a) C 5 + (Pr sin a + P T sin a) C 6 
+ (Pt cos a — P t cos a) CV + (Pp sin a — Pt sin a) C 8 
+ (PlPt cos a + PlPt cos a) Cg + (PlPt sin a + PlPt sin a) C\o 
+ (PlPt cos a — PlPt cos a) C\\ + (PlPt sin a — PlPt sin a) Ci 2 
+ PtPt [ cos(a + a) C13 + sin(a + a) Cu] 
+ PrPr [ cos(a — a) C15 + sin(a — a) Cie] , 



(31) 



where the coefficients C n (n = 1 - 16) are defined in terms of the helicity amplitudes by 



C i = I E [|(+-;AA)| 2 + |(-+;AA)| 2 ], C 2 = - E [|<+-;AA>| 5 
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C 8 = ~Qm £ ((++;AA) + (— ;AA))((-+;AA)-(+-;AA))*, 

A,A=± 

C 9 = ~5Re J «++;AA) + (— ;AA))((-+;AA)-(+-;AA))*, 

A,A=± 

C 10 = ^m J] ((++;AA) + (— ;AA))((-+;AA) + (+-;AA))*, 

A,A=± 

Cn = ~«e £ ((++;AA}-(— ; AA}) ((-+; AA) + (+-; AA})* , 

A,A=± 

C 12 = ^m £ «++;AA)-(— ;AA»«+-;AA)-<-+;AA»*, 

A,A=± 

C 13 = -^e £ [(_ + ;AA)(+-;AA)*], C 14 =^m £ [(-+; AA)(+-; AA}*] , 

A,A=± " A,A=± 

Ci5 = -^e £ [(— ;AA>(++;AA)*], C 16 = ^9ta £ [{— ; AA)(++; AA}*] . ( 32 ) 

A,A=± A,A=± 



The production cross section is then given in terms of the distribution S in Eq. fl3T|) by 

da N c (3 _ 



dcos0d$ 64 7r 2 s' 



(33) 



where iVc is the color factor of the final fermion; 3 for the top or bottom quark and 1 
for the tau lepton. The dependence of the distribution £ on the azimuthal angle <3> of the 
production plane is encoded in the angles a and a. If the azimuthal angle $ is measured 
with respect to the direction of the fi~ transverse polarization vector, the $ dependence 
can be exhibited explicitly by taking 

a = a = 1] - $ , (34) 

where 77 is the rotational invariant difference a — a of the azimuthal angles of the /i + and 
/i~ transverse polarization vectors with respect to the production plane. Clearly, only the 
six observables {6*1,(72,(73,(74,(715,(716} can be measured independently of the azimuthal 
angle, but the other ten observables, in particular, the observables involving the SV corre- 
lations, require the reconstruction of the production plane. 

The CP transformation on the polarization vectors of the initial muon beams corre- 
sponds to the simultaneous exchanges: 

P L ^ -P L , P T ^ P T , a^a. (35) 
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The CP relation ( |3"o] ) of the polarization vectors leads to the classification that the first 3 
terms and the distributions {C 5 , C 6 , Cxi, Ci 2 , Ci 3 , Cu, C15} in Eq. (pi]) are CP-even while 
the other six distributions {C 4 , C 7 , C 8 , C 9 , Ci , Ci 6 } are CP-odd. Among the CP-odd ob- 
servables, the three observables {C 4 , C 7 , C 9 } are CPT-odd and the other three observables 
{C 8 , C10, Ci 6 } are CPT-even. Here, it will be noteworthy to emphasize again that one 
crucial requirement for having a large CPT-odd observable is the presence of so-called 
CP-preserving re-scattering phases which can be provided by the Higgs boson propagators 
with relatively large widths in the present work. 



3.3 Initial spin correlations 

Let us now express the coefficients Cj (i 



1 to 16) in terms of the scalar and vector bilinear 



and quartic charges |26| as well as the newly-introduced notations: 



Rl — S ao , R2 — X! obSab, R-3 — X! a Sab, 
ab ab ab 



W^Y.Vab 

ab 



ab 



ab 



ab 
ab 



(36) 



which are to be employed for the interference between the scalar and vector contributions. 
It is worthwhile to note that both R3 and R4 vanish in the CP-invariant theory. The sixteen 
polarization distributions can be then classified as follows: 

(i) Scalar— scalar (SS) correlations: 



c 3 [++] 


1 

~ 2 


\l + P 2 ) 


Si- 


(1 


-p 2 ) 


s 2 


c,[— } 


1 

~ 2 


'(1+P 2 ) 


s[- 


(1 


-p 2 ) 




Ci 5 [++] 


1 

~ 2 




Si- 


(1 


-P 2 ) 


s 5 


c 16 [-+] 


1 

~ 2 




S' 4 - 


(1 


-p 2 : 


S' 5 



(37) 



where the first and second signatures in the square brackets are for the CP and CPT parities 
of the corresponding observable, respectively, and the relevant scalar quartic charges are 
defined as 
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S 2 = -3fte 
1 «. 



C C* _i_ c c* c' 

l_>_| — |-*-?_| ~~r 3 — 3 L ; 



s 



S R = - 



s ++ s*_ + + ss; 

0-| — ~r o-\ — o_ 



+ 



Ke 



q) 



2 
1 

2 

- Olll 



0_| — 1-^_| ^ O |_ 

S ++ S*_ + - SSI 

Q C* i Q C* 

*_)_| |_i_> ~r o_| o_ 



(38) 



(ii) Vector vector (VV) correlations: 

Ci[++] = (l + /3 2 cos 2 0)Vi + (l-/3 2 )V 2 + 2/3\/ 3 cos0, 
C 2 [++] = (1 + /3 2 cos 2 0) V/ + (1 - /3 2 ) V 2 ' + 2/3 V 3 ' cos 0, 
Ci3[++]=/? 2 sin 2 0\/ 4 , 
C 1 4+-]=(3 2 sm 2 QVl 

where the quartic charges V 3 and V 3 ' are given by 



(39) 



v, = - 

d 4 



V++| 2 + |V__| 2 -|^+ 
V, | 2 + IVL 



1/ I 2 



l^ + | 2 
IV I 2 



(40) 



and the other vector quartic charges are defined in the same way as the scalar quartic 
charges with the notation S replaced by V everywhere. We note that the scalar as well 
as vector quartic charges defined as an imaginary part of the bilinear-charge correlations 
might be non- vanishing only when there are complex CP-violating couplings or/and CP- 
preserving phases like re-scattering phases or finite widths of the intermediate particles. So, 
if there are no CP-preserving phases, non-vanishing values of these quartic charges signal 
CP violation in the given process. 



(iii) Scalar— vector (SV) correlations: 



C 5 [++] 
Cr[—] 

c 9 [— ] 

C n [++] 



rrif 



PsmQ^e(W 3 R* 1 ), C 6 [+- 



rrif 



/5sin0 9m(W^ lJ R*), 



-pt={3 sin Q$i e (w lR *^ C 8 [-+] 
4y s 



rrif 
rrif 



(3 sin ene(W 3 R* 3 ), C 10 [-+] = (3smQ R* 3 ), 



psmB^eiW^l), C 12 [+- 



m f 



4v^ 



/3sin0Sm(W^ 3J R*). (41) 



All the SV correlations are proportional to the mass of the final-state fermion divided by 
the cm. energy so that they are strongly suppressed at high energies. In this light, they 
are sizable only in the production of the top-quark pair because of the largest fermionic 
mass. 
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3.4 Final spin correlations for Higgs interference effects 

Various types of experimental observables by use of the initial muon polarization have been 
considered in the previous section for determining the CP character of the neutral MSSM 
Higgs bosons. In addition, spin correlations of ti or t + t~ in the final state can also probe 
the CP nature of the Higgs boson, independently of or combined with initial beam polariza- 
tion. If the production plane or directly the momentum directions of two final fermions are 
determined, the secondary decays of the primary final state fermions can allow a complete 
analysis of their spin or helicity directions. However, even if the production plane is not 
reconstructed, one can obtain the fermion-pair polarization combination by statistically 
studying decay products from the correlated and polarized //. It is then natural that the 
production distribution needs to be integrated over the azimuthal angle $. 

The s-channel Higgs boson (spin-0) exchange populates the equal yT 'fi + helicity com- 
binations, i.e. a — a. This results in the correlations of // polarization with A = A by 
angular momentum conservation, while the SM background channels yield dominantly the 
(H — ) or ( — h) polarization combination. In addition, the CP transformation interchanges 

the (++) and ( ) helicity configurations. In the light of these two arguments combined 

with the one in the previous paragraph, it will be valuable to consider the ^-independent 
polarization observable|: 

A^E E A(aa;AA)( ( x' ( T';AA)V; (7 ,p^ 

A aa'cra' 

= (l + P L P L ) Di + (P L + P L ) D 2 + P T P T [ cos r] D 3 + sin rj D A ] , (42) 
where the distributions Di (i = 1 to 4) are defined in terms of the helicity amplitudes as 

^i[ ] = A [|<++; AA>| 2 + |< — ;AA)| 2 " , 

4 A 

D 2 i++} = W*[\(++;^)\ 2 -\(—>^}\ 2 , 

4 A 

Ds[—\ = ~l^eJ2 A [(— ; AA)(++; AA)*] , 

A A 

D 4 [+-\ = -\ SmE A [<— ; AA)(++; AA)*] , (43) 

1 A 

where the first and second signatures in the square brackets are for the CP and CPT parities 
of the corresponding observable. 

■^In principle, there can exist the 7 and Z-exchange terms corresponding to the polarization combinations 
(1 — Px Pt) and (Pi — Pi) of the initial beams. However, those terms turn out to be zero for the 

real vector and axial-vector couplings in the approximation of neglecting the Z-boson width. 
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3.5 CPT— even and odd combinations of Higgs— boson propagators 



The CPT parity of each observable plays a crucial role in determining the interference 
pattern of the Higgs bosons among themselves and with the 7 and Z bosons appearing in 
the observable; every CPT-even (odd) observable involving only the scalar contributions 
depends on the real (imaginary) part of the combination Dn k D* Hi of each pair of two Higgs- 
boson propagators. The CPT-odd observable C14 involving only the vector contributions 
is negligible because the Z-boson width effect is significantly small for the energy far from 
the Z-boson pole. When the Z-boson width is neglected, all the vector couplings are real. 
As a result, the interference terms between the scalar and vector contributions depends on 
the real or imaginary parts of the Higgs-boson propagators D Hk itself. 

For the sake of discussion in the following, let us introduce for the real and imaginary 
parts the abbreviated notations: 

S kl = ^e[D Hk D* H[ ] 

V kl = Zm[D Hk D* Hi ] 

It is worthwhile to note two points; (a) the denominator reveals a typical two-pole structure 
so that the Higgs-boson contributions are greatly enhanced at the poles; (b) the numerator 
of is negative in the middle of two resonances with a mass splitting larger than their 
typical widths but positive otherwise, while the numerator of V k i is always positive (nega- 
tive) if > m H k ( m H k > m Hi) and linearly increasing (decreasing ) if m^T^ > rriH k ^H k 
(m Hk T Hk > m Hl T Hl ), respectively. 

On the other hand, the SV interference terms depend on the real and imaginary parts 
of each Higgs-boson propagators D Hk , the form of which is given by 

MD Hk ] = t S 2 \f HK 2 r2 , ampffj = -7 ? H sf/" 2 r2 • ( 45 ) 

(s - m 2 Hk ) 2 + m 2 H T 2 Hk (s ~ m 2 Hk ) 2 + m 2 Hk F 2 Hk 

Note that the real part changes its sign whenever the cm. energy crosses the pole, but the 
imaginary part is always negative. 

Combining the coefficients from the mixing matrix elements with those propagator- 
dependent parts enables us to make a straightforward qualitative understanding of the ^Js 
dependence of each observable. This will be demonstrated in detail in the following section 
with a concrete numerical example. 



( s - mj Ms - m 2 H ) + m Hk m Hl T Hk T Hl 



m 



H k 



) 2 + m 2 Hk r 2 ][( s 



m 



Hi 



m, 



,r 



m 



H k 



m H .Y 



Hi 



m 



H, 



m H k F Hk 



[(s-m 2 ) 2 + m 2 r 2 ][(s 



m 2 ) 2 



+ m 2 Hl T 2 [ 



(44) 
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4 Numerical Results 

We are now ready to present some numerical results. It is known that loop-induced CP 
violation in the Higgs sector can only be large if both and \A t \ (or \A{,\, if tan/3 3> 1) are 
sizable |6|, |7|, |[. We therefore choose \A t \ = \A b \ = 2mQ. For definiteness we will present 
results only for the ti mode by taking tan/3 = 3, 10 when probing the region around two 
heavy Higgs-boson resonances, but we will give a qualitative description of probing the CP 
property of the lightest Higgs boson. We take the running Yukawa couplings by including 
the QCD loop effects depending on the gluino mass properly. Since for moderate values of 
tan (3 the contributions from the (s)bottom sector are still quite small, our results are not 
sensitive to and At,; we therefore fix = my = mg, although different values for the 
SU(2) doublet and singlet soft breaking squark masses, uiq ^ are allowed, and also 
take equal phases for A t and A b . Since we are basically interested in distinguishing the CP 
non-invariant Higgs sector from the CP invariant one, we take for the re-phasing-invariant 
phase of A t ^ixe 1 ^ two values; (CP invariant case) and tt/2 (maximally CP violating 
case). On the other hand, we fix for simplicity the other real mass parameters and couplings 
except for tan /3 as follows: 

m A = 0.4TeV, \A t , b \ = l.OTeV, |/i| = 1.0TeV, 

m g = 0.5 TeV, uIq = = = 0.5 TeV . (46) 

Finally, we take for the top and bottom quark running masses rht(m t ) = 165 GeV and 
r?T,£,(r?T-b) =4.2 GeV. For the given ttla much larger than mz, two neutral Higgs bosons have 
almost degenerate masses: 



tan (3 = 


3. 


= 





: m H2 


= 400.0 GeV, 


m H3 


= 400.4 GeV, 




tan/3 = 


3, 


= 


71 

2 


: m H2 


= 396.6 GeV, 


m H . A 


= 404.5 GeV, 




tan/3 = 


10, 


^Afi = 





■ rn H2 


= 397.5 GeV, 


m Hz 


= 400.0 GeV, 




tan (3 = 


10, 


^Afi = 


7T 

2 


: m H2 


= 397.3 GeV, 


m H3 


= 400.5 GeV. 


(47) 



As a result, a significant overlapping, i.e. interference between two Higgs-boson resonances 
is expected. 

In the previous section, we have listed 16 polarization observables constructed solely by 
initial muon polarizations under the assumption that the production plane is (at least statis- 
tically) reconstructed, and 4 additional polarization observables by combining initial muon 
polarizations and final equal helicity configurations only for the case when the production 
plane does not have to be explicitly reconstructed. For some polarization observables it is 
also important to experimentally identify the electric charges of the produced fermion pair 
from their decay products. Taking into account all these requirements naturally leads us to 
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the following classification; for the energy range around the heavy Higgs boson resonances 
the production of a top quark pair is recommended to be used (when the heavy Higgs-boson 
masses are larger than twice the top-quark mass), and for the energy close to the lightest 
Higgs mass, the tau lepton or bottom quark pairs are recommended to be considered^ 



4.1 Two heavy Higgs bosons for top— pair production 

In the MSSM two heavy Higgs bosons are (almost) degenerate with a mass splitting com- 
parable to or less than their widths for Ma 3> mz as in the case of the parameter set (f|§), 
and one of them is CP-even and the other CP-odd in the CP invariant theory. However, 
the CP-violating neutral Higgs-boson mixing can cause a mass splitting larger than their 
typical widths and it can lead to several significant non-vanishing CP-odd observables, in 
particular, in the tt mode. In this section, we investigate in detail the possibility of probing 
those aspects through the observables classified in the previous section by considering the 
cases without and with direct reconstruction of the production plane separately. 



4.1.1 Without direct reconstruction of the production plane 

If the production plane is not directly reconstructed but only the helicities of the pro- 
duced top quark and anti-quark are statistically determined, all the interference between 
the scalar and vector contributions is averaged away over the azimuthal angle $ and only 
the observables, {C%, C 2 , C 3 , C 4 , C15, Ci 6 ; Di, D 2 , D 3 , D4} can be reconstructed. 

Figures |3] and |] exhibit six independent observables of definite CP and CPT parities 
near the region of the heavy Higgs-boson resonances; 

(a)a RL [++], (b)a M [++], (c)/(d) g **^ g " [±±], (e) *,,[++], (fW-+], 

for tan (3 = 3, 10 in Figs. and [|, respectively. The observables obtained by controlling 
solely the muon and anti-muon polarizations are given by 



a 



J dcosQ [Ci±C 2 ] , 



Nc£ 

RL/LR 16ns 

N c (3 

"II A = ^(±)^5/16. (4? 



§The bb decay mode of the lightest Higgs boson, even if it has the largest branching fraction, is not 
useful for certain observables because of the difficulty in determining the polarization and electric charge 
of the produced bottom quark and anti-quark experimentally. 
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As shown in the frames (a) and (b) the spin-1 (LR) and (RL) observables cr^ and ctrl 
in both figures are almost constant and the former is almost twice larger than the latter, 
showing the large left-right asymmetry. On the other hand, the average of the observables 
an and a RR showing the Higgs-boson contributions are peaked on each heavy Higgs-boson 
resonance and the size at each pole is comparable to that of the spin-1 observable. In the 
CP invariant case (&ah = 0) with tan [3 = 3 the parameter set ( f46|) with tan (3 = 3 acci- 
dentally generates two extremely degenerate Higgs bosons as denoted by a single resonance 
line in the frame (c) as well as a single oscillating pattern in the frame (e) for cry of Fig. |3] 
unlike the case for tan (3 = 10 with a finite mass splitting of about 3 GeV. The CP-odd ob- 
servables (ct&r — a LL )/2 and crj_ are identically zero for both tan (3 = 3 and 10 as they ought 
to be. On the other hand, in the CP non-invariant case a large mass splitting between two 
Higgs-boson resonances is developed for tan/? = 3, implying a large CP-violating mixing 
between two Higgs bosons, while the splitting in the case of tan (3 = 10 is not so much en- 
larged. A more quantitative understanding about the mass splitting can be obtained from 
Eq. (0). In this case, the CP-odd observables are non-vanishing. Note that observable 
cr_i_ are quite sizable on the poles, especially, in the case of tan (3 = 3. 

The observable (& RR — a LL )/2 in the frame (d) is CPT-odd, involving the propagator 
combination V^, but the observables an and a± in the frames (e) and (f) are CPT-even, 
involving the propagator combination Sm- Examining the analytic structure of those ob- 
servables and taking into account the parameter set fl46|) , we find that (i) the coefficient 
related with the CP-odd (CP-even) resonance pole is negative (positive), respectively; (ii) 
for tan (3 = 3 the lighter (heavier) resonance of the heavy Higgs bosons is dominantly CP- 
odd (CP-even) in both the CP invariant and non-invariant cases, respectively; (iii) for 
tan/3 = 10 the lighter resonance is dominantly CP-even (CP-odd) and the heavier one 
CP-odd (CP-even) in the CP invariant (non-invariant) case for = (vr/2), respec- 
tively. Combining all these features leads to a symmetric resonance pattern in the frame 
(d) and anti-symmetric patterns in the frames (e) and (f) in both figures and a remarkable 
sign flipping at each resonance pole in the frame (e) of Fig. f|. 

We present in Fig. |5| three observables^ related with the difference between the cross 
sections with the (++) and ( ) helicity configurations: 

A *»~ A " [++], An[—], 

near the heavy Higgs-boson resonances, the explicit form of which is obtained by integrating 

^The sum A RR + A LL is strongly suppressed in the present case due to the orthogonality of the neutral- 
Higgs mixing matrix O: sin/3 is very close to unity even for tan/3 = 3 such that the product sum 
Oik02i + s^OikOu is approximately Ski, i-e. vanishing in the present case because of k ^ I forced by 

the antisymmetric combination 0\kS( — S[Ou with Sf = O3; for / = t. 
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the distributions {-D2, -D3, -D4} over the production angles as 



A 



N c f3 



[D 1 ±D 2 ] 



A 



N c (3 




(49) 



RR/LL 



8ns 



16 71 S 



It should be noted that every observable (i — 1 to 4) involves the antisymmetric com- 
bination (OikOsi — OskOu) forcing k 7^ I (k,l = 1,2,3). Because two heavy Higgs bosons 
exhibit almost a typical two-state mixing for the parameter set ([46]), there exist simply 
one coupling combination formed by the mixing matrix elements for each observable. As 
a result, the y/s dependence of each observable is (almost) completely determined by that 
of the propagator combinations 1S23 or D 2 3, depending on whether the observable is CPT- 
even or CPT-odd. As two Higgs bosons are extremely degenerate in the CP invariant case 
with tan/5 = 3 a single resonance peak (solid line) is shown in the first two upper frames 
of Fig. However, we note in the upper part of Fig. [5| that (i) in the CP non-invariant 
case (<&An = 7r /2) a large mass splitting is developed; and (ii) the CPT-even observable 
(Arr — All)/2 changes its sign at each resonance pole as £23 does, while the other two 
CPT-odd observables have a two-pole structure of the same sign. On the other hand, the 
mass splitting between two heavy Higgs bosons for tan/3 = 10 is not so different in the 
CP invariant and non-invariant cases. As explained in the case of tan (3 — 3, one can see 
a sign change at each resonance pole in the CPT-even observable and a typical two-pole 
structure in the CPT-odd observables. It is also noteworthy that the observable Aj_ is 
negative (positive) for the CP invariant (non-invariant) case. Finally, the typical size of 
the CP-odd observables is very small compared to that of the CP-even observables. 

4.1.2 With direct reconstruction of the production plane 

All the terms involving interference between the scalar and vector contributions requires a 
reasonable identification of the production plane and they are proportional to the mass of 
the final fermion. The r + r~ mode with two final neutrinos escaping detection can be used 
at high energies where the produced tau leptons are very energetic and therefore their decay 
products fly along the original tau direction to a very good approximation. Nevertheless, 
the small mass leads to very small interference effects. On the other hand, the production 
plane in the ti mode can be determined without big difficulty and the top-quark mass is 
almost 100 times larger than the tau-lepton mass. In this light, we will concentrate on the 
ti mode which could generate significant interference effects. 

Among the eight interference terms the four terms {C7, C 8 , C 9 , C w } are CP-odd and 
the other four terms {C 5 , C 6 , Cn, Cu} are CP-even. It is noteworthy that all the CP-odd 
terms are proportional to R3 while all the CP-even observables to R\\ as a matter of fact 
the CP properties of the interference terms originates from those of R\ and -R3 as can be 
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worked out by their explicit form for the tt mode: 

3 3 

R x = -2h^h f £ D Hk 2k 3k , R 3 = 2ih^h f s p Yl D H k lk 3k . (50) 
fc=i fc=i 

We note that (i) Ri describes the CP-preserving mixing between two CP-even states, <pi 
and 02, so that the relevant observables can be used to select the dominantly CP-even 
Higgs-boson states; (ii) the coefficients O22O32 and O23O33 have an equal sign while the 
coefficients O12O32 and O13O33 have an opposite sign; (iii) R 3 the CP-violating mixing 
between </> 2 and the CP-odd state a. In addition, the coefficients W\$ involving vector 
bilinear charges are (almost) real to a very good approximation so that the SV interference 
terms depends on the real and imaginary parts of each Higgs-boson propagator Dn k itself. 

Certainly we need to apply an appropriate ^-dependent weight function to extract each 
interference term; for example, (cos a — cos a) with P? = Pt — 1 taken can be used as a 
weight function to extract Cj. The extraction efficiency should be determined with the 
detailed information on various experimental machine parameters. So, we will not provide 
any further detailed procedure to extract those observables, but concentrate ourselves on 
the observables Cj themselves. Let us define the observables Oi (i = 5 to 12) as: 

Uj = — /dcosGCj, (51) 
so that Oi has the same CP property as Cj. 

Taking the maximal CP-violating phase §A\i — 7T /2, we present in Fig. |6] the CP-odd 

observables {a 7 [ ], cr 8 [ — h], erg[ ], er 10 [ — h]} for the tt mode near the heavy Higgs-boson 

resonances for tan /3 = 3 (solid line) and tan /? = 10 (dashed line) with the SUSY parameter 
set ([46]). The CPT-even observables ag and 010 changes their sign at each pole as the real 
part of each Higgs-boson propagator changes its sign. On the other hand, the fact that the 
coefficients Oi 2 O32 and O13O33 have an opposite sign is responsible for the sign-flipping 
pattern at the poles, appearing in the left frames of Fig. |6|. On the whole, among those 
CP-odd observables <t 7 and cr 10 are sizable while the other two observables are small in size. 

Figure ^ shows the CP-even observables {cr 5 [++], cr 6 [H — ], <7n[++], 012 [H — ]} for the ti 
mode near the heavy Higgs-boson resonances for = (solid line) and = 7t/2 
(dashed line) with the SUSY parameter set (0). In this case, we take tan/5 = 3 causing 
a larger CP-violating Higgs-boson mixing than tan/3 = 10. As explained before, the 
observables dependent on the coefficients 02 k 3k single the dominantly CP-even states 
out. As can be seen in every frame of Fig. [7] the heavier Higgs boson of two heavy Higgs 
bosons is (dominantly) CP-even in the case of = and tt/2, respectively. The CPT- 
even observables 05 and a%% show a sign change at the Higgs-boson resonance pole, while 
the CPT-odd observables show a typical peak. 
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4.2 The lightest Higgs boson 



According to a detailed analysis [15 of Higgs boson decays, the width of the lightest Higgs 
boson H\ is of the order of MeV for intermediate tan f3, which is smaller than a typical muon 
energy resolution. The lightest Higgs boson decays dominantly into bb and sub-dominantly 
into t + t~ with the (almost) fixed branching fractions and the interference between the 
Higgs-exchange and the 7 and Z-boson exchanges is negligible because of the small b and 
r masses compared to the Higgs-boson mass, even if the muon beam polarization is em- 
ployed. Furthermore, T(Hi — > /r/r) = T(Hi — * fhlh) at the tree level so that any further 
information on the CP property of the lightest Higgs boson will not be obtained by mea- 
suring the difference between the final (++) and ( ) helicity configurations^. 

A convolution of the Higgs-boson production cross section with the beam energy dis- 
tribution tends to reduce the production rate as given by the expression 

^i?ie// ~ n ^ T, Hl (m Hl ), (52) 



where oe is the muon beam energy resolution and the distribution is given by 

(m m ) = (l + Pl Pi) C 3 + (P L + P L ) C 4 + P T P T [ cos 77 C 15 - sin 77 C 16 ] . (53) 



Every Ci is proportional to the second power of m,H 1 /Th 1 and factored into the production 
and decay parts on the lightest Higgs-boson resonance pole. So, apart from the factor 
depending on the beam energy resolution, the CP property of the lightest Higgs boson can 
be directly investigated through the Higgs-boson resonance production by polarized muon 
and anti-muon collisions as well as through final fermion spin-spin correlations with high 



efficiencies. The reduction factor in Eq. (52) clearly shows the importance of having a very 
good beam energy resolution in order to obtain the spin-0 Higgs-exchange signal events 
clearly distinguished from the spin-1 7/Z-exchange background events. Since several works 
fT6| , |2C| ^TJ along this line have been already done, we close this section to referring to the 
relevant recent works. 



5 Summary and Conclusion 

We have performed a systematic investigation of the production of a third-generation 
fermion-pair in polarized /x 4 ' [i~ collisions so as to probe the explicit CP violation in the 
MSSM Higgs sector, induced radiatively by soft trilinear interactions related to squarks of 
the third generation. We have classified all the observables for probing the CP property of 

"The identification of the t + t~ helicities is, however, quite useful to reduce the continuum backgrounds 
from the 7 and Z exchanges |27j . 
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the Higgs bosons constructed by the initial muon beam polarization along with the final 
fermions of no polarization and of equal helicity, respectively. The polarization observ- 
ables have turned out to allow for complete determination of the CP property of the Higgs 
bosons. Furthermore, we have found that the interference between the spin-0 Higgs-boson 
and spin-1 j/Z contributions can provide a powerful and independent means for the deter- 
mination of the CP property of two heavy Higgs boson in the top-quark pair production 
with the cm. energy near the (almost) degenerate heavy Higgs-boson resonances. On the 
other hand, there is no sizable interference between the lightest Higgs-boson and spin-1 
j/Z contributions so that the CP property of the lightest Higgs boson can be optimally 
measured on its pole by using the initial muon beam polarization or the final fermion spin- 
spin correlations with high efficiencies while keeping a very good beam energy resolution. 

In conclusion, the third-generation fermion-pair production in collisions equipped 

with initial muon beam polarization and final-fermion spin correlations provides a powerful 
probe of the CP property of the Higgs bosons in the MSSM with explicit CP violation. 
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Figure 3: The six independent observables of definite CP and CPT parities; (a) cr M [++], 
(b) cr LR [++], (c)[o- RR + a LL ]/2[++], (d)[a RR -a LL }/2\—}, (e) a {{ [++} and (f) a ± [-+], 
near the region of the heavy Higgs-boson resonances for tan f3 = 3 and the SUSY parameter 
set The definition of the observables is given in Eq. ft4$l)- The solid line is for $^ = 

and the dashed line for = ir/2. 
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Figure 4: The same six independent observables as in Fig. [| near the region of the heavy 
Higgs-boson resonances for tan j3 = 10 and the SUSY parameter set (JB). The solid line is 
for = and the dashed line for = n/2. 



27 



(A RR -A I T ,)/2 [pb] 



tan [3=3 

A, [pb] 




1 p- 

0.75 E- 

0.5 E- 

0.25 E~ 

— 



390 400 410 390 400 410 



V s [GeV] 



(A RR -A„ )/2 [pb] 



V s [GeV] 



tanp=10 

A x [pb] 



0.5 



-0.5 




0.5 



-0.5 



390 400 410 390 400 410 



V s [GeV] 



V s [GeV] 




-20 
-40 
-60 



390 




-20 
-40 
-60 



390 



A., [fb] 



400 410 

V s [GeV] 



A. [fb] 



400 410 

V s [GeV] 



Figure 5: The three observables of definite CP and CRT parities; [A BS — A iL ]/2[++] 

(left), Aj_[H — ] (middle), and Ay[ ] (right) near the region of the heavy Higgs-boson 

resonances for tan/? = 3 (upper set) and tan/3 = 10 (lower set) with the SUSY parameter 
set fcffi). The definition of the observables is given in Eq. ffiDj). The solid line is for = 
and the dashed line for = n/2. 
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Figure 6: The four CP-odd observables {a 7 [ ], er 8 [ — h], 0g[ ], 0io[— +]} f or the ti mode 

near the heavy Higgs-boson resonances with the SUSY parameter set $(\). The solid line is 
for tan/3 = 3 and the dashed line for tan/3 = 10. The definition of the observables is given 
in Eq. The CP phase is taken to ir/2. 
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